Image stabilization method and electronic device therefor

ABSTRACT

An electronic device includes: a camera; a display; and at least one processor electrically connected to the camera and the display. The at least one processor is configured to: obtain an image data from the camera; output a preview image of the image data on the display, based on a configured magnification; detect at least one object of the preview image in a state in which the configured magnification is greater than a reference magnification; and perform an image stabilization on the preview image, based on the detected at least one object of the preview image.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a by-pass continuation application of InternationalApplication No. PCT/KR2021/010431, filed on Aug. 6, 2021, which based onand claims priority to Korean Patent Application No. 10-2020-0105606,filed on Aug. 21, 2020, in the Korean Intellectual Property Office, thedisclosures of which are incorporated by reference herein in theirentireties.

BACKGROUND 1. Field

The disclosure relates to an electronic device for image stabilizationduring photographing by a camera and a method therefor.

2. Description of Related Art

Image stabilization in camera functions is an essential and importantfunction to obtain clear pictures. In general, image stabilizationincludes Optical Image Stabilization (OIS) and Digital ImageStabilization (DIS). OIS is a method of reducing shaking by moving alens or sensor, and DIS is a method of reducing shaking by digitalprocessing, which is, adopted by a portable terminal.

As zoom magnification supported by electronic devices increases, usersmay magnify a preview screen at a very high magnification. However, in acase where digital zoom is applied to provide a high-magnificationimage, the electronic device outputs only some of image data obtained byan image sensor as preview data or stores the same as an image file.

As the zoom magnification increases, a motion of a preview image causedby the movement of the mobile phone greatly increases, and in a casewhere the DIS is performed in high magnification photographing, theimage stabilization range is calculated as a size ratio of the previewimage and an image data obtained by a camera, so performance of imagestabilization eventually deteriorates.

In addition, since the above image stabilization is not intended forstabilization of the image data by distinguishing a slight shake from afine adjustment by a user, the stabilization may not be performedagainst the user's intention or may be performed with an unwantedstabilization strength. For example, the image stabilization may not beapplied to the motion of an image caused by a user who is intentionallymoving the electronic device to change a Field Of View (FOV).

One or more embodiments of the disclosure may provide an electronicdevice that performs image stabilization against an unintentional shakeof the user during photographing an image in a high-magnification mode,thereby stably capturing the image. One or more embodiments of thedisclosure may also provide a method performed by the electronic device.

Technical problems to be solved in the disclosure are not limited to thetechnical problems mentioned above, and other technical problems notmentioned will be clearly understood by those skilled in the art towhich the disclosure belongs from the description below.

SUMMARY

According to an aspect of the disclosure, an electronic device includes:a camera; a display; and at least one processor electrically connectedto the camera and the display. The at least one processor is configuredto: obtain an image data from the camera; output a preview image of theimage data on the display, based on a configured magnification; detectat least one object of the preview image in a state in which theconfigured magnification is greater than a reference magnification; andperform an image stabilization on the preview image, based on thedetected at least one object of the preview image.

According to another aspect of the disclosure, a method of operating anelectronic device, includes: obtaining an image data from a camera;outputting a preview image of the image data on a display, based on aconfigured magnification; detecting at least one object of the previewimage obtained by the camera in a state in which the configuredmagnification is greater than a reference magnification; and performingan image stabilization on the preview image, based on the detected atleast one object of the preview image.

According to another aspect of the disclosure, an electronic deviceincludes: a camera; a display; and at least one processor electricallyconnected to the camera and the display. The at least one processor isconfigured to: output a preview image of an image data, based on aconfigured magnification, on the display; perform an image stabilizationby configuring a parameter value as a first value; determine whether anobject is detected within a specified area of the preview image for apredetermined time; and change the parameter value to a second value,based on a determination that the object is detected within thespecified area of the preview image for the predetermined time andperform the image stabilization by configuring the parameter value asthe second value. The second value is different from the first value.

According to one or more embodiments of the disclosure, an imagestabilization function may be automatically provided as an object to bephotographed is recognized.

In addition, according to one or more embodiments, it may be possible toprovide a user with an image that is not shaken in a high-magnificationphotographing environment. In addition, various effects identifieddirectly or indirectly through the disclosure may be provided.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other aspects, features, and advantages of certainembodiments of the disclosure will be more apparent from the followingdescription taken in conjunction with the accompanying drawings, inwhich:

FIG. 1 illustrates an electronic device In an embodiment;

FIG. 2 illustrates an operation of performing image stabilization in anelectronic device In an embodiment;

FIG. 3 illustrates an operation of performing image stabilizationaccording to whether an object is detected in an electronic device In anembodiment;

FIG. 4 illustrates an operation of changing a parameter value related toimage stabilization according to whether object detection satisfiespredetermined conditions in an electronic device In an embodiment;

FIG. 5 illustrates an operation of adjusting strength of imagestabilization according to whether a trigger event related to imagestabilization occurs in an electronic device In an embodiment;

FIG. 6 illustrates a graph in which the strength of image stabilizationchanges depending on whether a trigger event related to imagestabilization occurs in an electronic device In an embodiment;

FIG. 7 illustrates a user interface related to a trigger event ofincreasing the strength of image stabilization in an electronic deviceIn an embodiment;

FIG. 8 illustrates a user interface related to a trigger event oflowering the strength of image stabilization in an electronic device Inan embodiment;

FIG. 9 illustrates a margin area in an electronic device In anembodiment;

FIG. 10 illustrates an operation of changing the strength of imagestabilization by determining motion of an electronic device In anembodiment;

FIG. 11 illustrates an operation of controlling a display when a triggerevent related to image stabilization occurs in an electronic device Inan embodiment;

FIG. 12 illustrates that a display varies on a display as a triggerevent related to image stabilization occurs in an electronic device Inan embodiment;

FIG. 13 illustrates an electronic device in a network environmentaccording to one or more embodiments; and

FIG. 14 illustrates a camera module according to one or moreembodiments.

DETAILED DESCRIPTION

Hereinafter, one or more embodiments of this document will be describedwith reference to the accompanying drawings. However, this is notintended to limit this document to specific embodiments and should beunderstood to encompass various modifications, equivalents, and/oralternatives to the embodiments of the disclosure.

FIG. 1 shows an electronic device. In FIG. 1 , a display 110 may bedisposed on a front surface of an electronic device 100 (e.g., theelectronic device 1301 in FIG. 13 ). In an embodiment, the display 110may occupy a majority of the front surface of the electronic device 100.The display 110 and a bezel 120 surrounding at least some edges of thedisplay 110 may be disposed on the front surface of the electronicdevice 100.

In FIG. 1 , the display 110 may include a flat area 111 and a curvedarea 112 extending from the flat area 111 toward the side of theelectronic device 100. Although the curved area 112 is shown only on oneside (e.g., the left side) in FIG. 1 , the curved area is formed on theopposite side as well. In addition, the electronic device 100illustrated in FIG. 1 is only an example, and one or more embodimentsare possible. For example, the display 110 of the electronic device 100may include only the flat area 111 without the curved area 112 or mayinclude the curved area 112 only on one edge, instead of both edges. Inaddition, in an embodiment, the curved area may extend to the rearsurface of the electronic device 100 so that the electronic device 100may include an additional flat area.

In an embodiment, a fingerprint sensor 141 for recognizing a user'sfingerprint may be included in a first area 140 of the display 110. Thefingerprint sensor 141 may be disposed under the display 110 so as to beinvisible or hardly visible to the user. In addition to the fingerprintsensor 141, a sensor for additional user/biometric authentication may bedisposed in a partial area of the display 110. In another embodiment, asensor for user/biometric authentication may be disposed in one area ofthe bezel 120. For example, an IR sensor for iris authentication may beexposed through one area of the display 110 or through one area of thebezel 120.

In an embodiment, a sensor 143 may be included in at least one area ofthe bezel 120 or at least one area of the display 110 of the electronicdevice 100. The sensor 143 may be a sensor for distance detection and/ora sensor for object detection. The sensor 143 may be disposed at a shortdistance from a camera module (e.g., a front camera 131 and a rearcamera 132) or may be formed as one module with the camera module. Forexample, the sensor 143 may operate as at least a part of an infrared(IR) camera (e.g., a Time-Of-Flight (TOF) camera or a structured lightcamera) or operate as at least a part of a sensor module (e.g., thesensor module 1376 in FIG. 13 ).

In an embodiment, a front camera 131 may be disposed on the frontsurface of the electronic device 100. Although it is illustrated thefront camera 131 is exposed through one area of the display 110 in theembodiment of FIG. 1 , in another embodiment, the front camera 131 maybe exposed through the bezel 120.

In an embodiment, the display 110 may include at least one or more of asensor module (e.g., the sensor module 1376 in FIG. 13 ), a cameramodule (e.g., a front camera 131, a rear camera 132, or a camera module1380 in FIG. 13 ), and a light-emitting device (e.g., an LED) on therear surface of a screen display area (e.g., the flat area 111 or thecurved area 112).

In an embodiment, a camera module may be disposed on the rear surface ofat least one of the front surface, side surface, and/or rear surface ofthe electronic device 100 so as to face the front surface, the sidesurface, and/or the rear surface. For example, the front camera 131 maybe an Under-Display Camera (UDC) that is not visually exposed to thescreen display area (e.g., the flat area 111 or the curved area 112). Inan embodiment, the electronic device 100 may include one or more frontcameras 131. For example, the electronic device 100 may include twofront cameras such as a first front camera and a second front camera. Inan embodiment, the first front camera and the second front camera may becameras of the same type having the same specification (e.g., pixels),but the first front camera and the second front camera may beimplemented as cameras having different specifications. The electronicdevice 100 may support functions related to a dual-camera (e.g., 3Dphotographing, auto-focus (AF), etc.) through two front cameras.

In an embodiment, a rear camera 132 may be disposed on the rear surfaceof the electronic device 100. The rear camera 132 may be exposed througha camera area 130 of a rear cover 160. In an embodiment, the electronicdevice 100 may include multiple rear cameras disposed in the camera area130. For example, the electronic device 100 may include two or more rearcameras. For example, the electronic device 100 may include a first rearcamera, a second rear camera, and a third rear camera.

The first rear camera, the second rear camera, and the third rear cameramay have different specifications. For example, the first rear camera,the second rear camera, and/or the third rear camera may be differentfrom each other in Field Of View (FOV), pixels, apertures, supportingoptical zoom/digital zoom or not, supporting an image stabilizationfunction or not, the type of set of lenses included in each camera,and/or arrangement thereof. For example, the first rear camera may be ageneral camera, the second rear camera may be a camera (wide-anglecamera) for wide angle photographing, and the third rear camera may be atelephoto camera. In the embodiments of this document, descriptions offunctions or characteristics of the front camera may be applied to therear camera, and vice versa.

In an embodiment, various types of hardware or sensors assistingphotographing, such as a flash 145, may be further disposed in thecamera area 130. For example, various sensors such as a distance sensorfor detecting a distance between a subject and the electronic device 100may be further included.

In an embodiment, the distance sensor may be disposed at a shortdistance from the camera module (e.g., the front camera 131 or the rearcamera 132) or formed as a single module with the camera module. Forexample, the distance sensor may operate as at least a part of aninfrared (IR) camera (e.g., a TOF camera or a structured light camera)or operate as at least a part of a sensor module (e.g., the sensormodule 1376 in FIG. 13 ). For example, the TOF camera may operate as atleast a part of a sensor module (e.g., the sensor module 1376 in FIG. 13) for detecting a distance to a subject.

In an embodiment, at least one physical key may be disposed on the sidepart of the electronic device 100. For example, a first function key 151for turning on/off the display 110 or turning on/off the electronicdevice 100 may be disposed on the right edge of the electronic device100, based on the front surface thereof. In an embodiment, a secondfunction key 152 for controlling the volume or screen brightness of theelectronic device 100 may be disposed on the left edge of the electronicdevice 100, based on the front surface thereof. In addition to this,additional buttons or keys may be disposed on the front or rear surfaceof the electronic device 100. For example, a physical button or a touchbutton mapped to a specific function may be disposed in a lower area ofthe bezel 120.

The electronic device 100 illustrated in FIG. 1 is only an example andis not intended to limit the shape of the device to which the technicalconcept disclosed in this document is applied. For example, thetechnical idea disclosed in this document may be applied to a foldableelectronic device capable of being folded horizontally or vertically byemploying the display 110 and a hinge structure, or a tablet or laptopcomputer. In addition, although the electronic device 100 of theillustrated example shows a bar-type or plate-type appearance, one ormore embodiments of this document are not limited thereto. For example,the illustrated electronic device may be a part of a rollable electronicdevice. The “rollable electronic device” may indicate that the display110 is able to be bent and deformed so that at least a portion thereofmay be wound or rolled, or received inside the electronic device 100.The rollable electronic device may enable the display 110 to be unfoldedor may expose a larger area of the display 110 to the outside accordingto the user's needs, so that the screen display area (e.g., the flatarea 111 and the curved area 112) may be extended and used. The display110 may be referred to as a slide-out display or an expandable display.Hereinafter, one or more embodiments will be described based on theelectronic device 100 shown in FIG. 1 .

FIG. 2 illustrates an operation of performing image stabilization in anelectronic device. In the description of FIG. 2 , the configurationsand/or functions described in FIG. 1 may be briefly described, ordescriptions thereof may be omitted.

In FIG. 2 , the electronic device 100 may use a hardware and/or softwaremodule to support functions for performing stabilization of an image.For example, a processor 210 (e.g., the processor 1320 in FIG. 13 ) maydrive a trigger module 201, an image stabilizer module 203, and aphotographing control module 205 by executing instructions stored in amemory 230 (e.g., the memory 1330 in FIG. 13 ).

In one or more embodiments, software modules other than those shown inFIG. 2 may be implemented. For example, at least two modules may beintegrated into one module, or one module may be divided into two ormore modules. In addition, the hardware and software modules may share asingle function, thereby improving work performance. For example, theelectronic device 100 may include both an encoder implemented ashardware and an encoder implemented as a software module so that some ofdata obtained by at least one camera module may be processed in thehardware encoder and the remaining data may be processed in the softwareencoder.

In an embodiment, the trigger module 201 may generate a trigger signalthrough a user's input and/or an object detection. The trigger module201 may provide the generated trigger signal to the image stabilizermodule 203. The trigger signal may include a first trigger event and asecond trigger event. The first trigger event may be a trigger event forincreasing the strength of image stabilization. The second trigger eventmay be a trigger event for reducing the strength of image stabilization.The first trigger event may be mentioned or referred to as a ‘lock’trigger. The second trigger event may be mentioned or referred to as an‘unlock’ trigger.

In an embodiment, the user's input may include at least a user's inputthrough a display touch and/or a user's input through a button input.The button input may include a physical button and/or a virtual button.The display touch input may share an AF signal. For example, the displaytouch input may include a user's touch input to the AF producedaccording to the execution of the AF.

In an embodiment, the object detection may include detecting an objectthrough an analysis of image data obtained by a camera 220 (e.g., thecamera module 1380 in FIG. 13 ). For example, the object detection mayinclude a natural object (e.g., moon and sun) detection, a facedetection, a body detection, and a gesture detection. The objectdetection may include simply detecting a basic shape of a natural objectand detecting modified shapes of the basic shape of the natural object.For example, the object detection may include detecting various types ofmoons, such as a crescent moon and a waxing moon, as well as a fullmoon.

In an embodiment, the object detection may include detecting at leastone object by using various detection methods. The trigger module 201may detect an object using Artificial Intelligence (AI) such as machinelearning. For example, the object detection may include detection of anobject by using a division technique (e.g., segmentation) and/or an edgedetection method. The edge detection method may detect an object using adifference in a color value between pixels. The various detectionmethods are not limited to the above-mentioned division technique andedge detection method and may include various methods previouslydisclosed.

In an embodiment, if a specific gesture is detected, the trigger module201 may transmit information about the specific gesture to thephotographing control module 205.

In an embodiment, the image stabilizer module 203 may calculate themovement of an electronic device through a motion sensor included in theelectronic device 100. The image stabilizer module 203 may calculate theposition (e.g., the current position) of the electronic device 100and/or the position at the time at which a trigger occurs in order tolock up a FOV at the trigger occurrence time.

The image stabilizer module 203 may obtain a trigger signal transmittedfrom the trigger module 201 and adjust the strength of imagestabilization. For example, if a lock trigger event occurs, the imagestabilizer module 203 may increase the strength of image stabilization,based on the position of the electronic device 100 at the time that thelock trigger occurs. In contrast, when an unlock trigger event occurs,the image stabilizer module 203 may reduce the strength of imagestabilization.

In an embodiment, the motion sensor may include an accelerometer sensor,a gyro sensor (gyroscope), a magnetic sensor, or a Hall sensor. However,these sensors are exemplary, and the motion sensor may further includeat least one other type of sensor.

In an embodiment, the acceleration sensor is a sensor configured tomeasure the acceleration acting in three axes (e.g., the X-axis, theY-axis, or the Z-axis) of the electronic device 100 and may measure,estimate, and/or detect the force applied to the electronic device 100using the measured acceleration.

In an embodiment, the gyro sensor is configured to measure the angularvelocity acting in the three axes of the electronic device 100 and maymeasure and/or detect the amount of rotation of the electronic device100 with respect to each axis using angular velocity informationmeasured in each axis.

In an embodiment, the magnetic (geomagnetic or geomagnetic field) sensorand the Hall sensor may include a transmitter for generating a magneticfield of a specific frequency and a receiver for receiving the magneticfield generated by the transmitter. Those sensors may obtain themovement direction and/or movement distance of the electronic device100. The magnetic (geomagnetic) sensor may measure a bearing using themagnetic field and magnetic force lines.

The Hall sensor may detect the strength of magnetic field to identifythe movement of the electronic device 100. The Hall sensor may beconfigured as at least a part of the camera 220 (e.g., the camera module1380 in FIG. 14 ), thereby performing a function of an image stabilizer(e.g., the image stabilizer 1440 in FIG. 14 ). For example, the camera220 may perform an image stabilization function using a coil and/or amagnet of the image stabilizer (e.g., the image stabilizer 1440 in FIG.14 ) and identify the positional displacement of the magnet, based on achange in the magnetic field identified through the Hall sensor.

In an embodiment, the photographing control module 205 may provide theuser with a user interface (UI)/graphical UI (GUI) related to the cameraon the display 110. In addition, the photographing control module 205may control a photographing operation in response to a user's inputprovided through a UI/GUI output to the display 110.

For example, the photographing control module 205 may obtain a recordingstart/stop input from the user and transmit the obtained recordingstart/stop input to the encoder. The input obtained from the user mayinclude an input obtained via a voice recognition function or detectionof a specific gesture. For example, if the processor 210 recognizesvoices such as “capture”, “shoot”, and “stop shooting,” it maystart/stop photographing in response thereto. Alternatively, if theprocessor 210 detects a gesture of showing a palm, it may start/stopphotographing in response thereto.

In an embodiment, the display 110 may include an execution screen of anapplication executed by the processor 210 or content such as imagesand/or videos stored in the memory 230. In addition, the processor 210may display image data obtained by the camera 220 on the display 110 inreal time. The display 110 may output a preview area, as a previewimage, cropped and/or resized to conform to the resolution of thecurrent preview image.

In an embodiment, an image signal processor 240 (e.g., the image signalprocessor 1460 in FIG. 14 ) may perform a stabilization operation onimages obtained from by camera 220. In an embodiment, the stabilizationoperation may include at least one of Auto-Exposure (AE), AF, andAuto-White Balance (AWB). In addition, the image signal processor 240may improve a quality of the obtained image or apply a desired effectthereto through an appropriate resolution adjustment/tuning operation inaddition to the AE, the AF, and/or the AWB.

In an embodiment of FIG. 2 , functions performed by the trigger module201, the image stabilizer module 203, and the photographing controlmodule 205 may be performed by the processor 210 executing instructionsstored in the memory 230. In addition, in one or more embodiments, theelectronic device 100 may use one or more hardware processing circuitsin order to perform various functions and operations disclosed in thisdocument.

For example, an Application Processor (AP) included in a mobile device,an Image Signaling Processor (ISP) mounted to a camera module, a DisplayDriver Integrated Circuit (DDIC), a touch IC, a Communication Processor(CP), a hardware encoder, or the like may be used for the implementationof the one or more embodiments disclosed in this document. In addition,the connection between the hardware/software shown in FIG. 2 isprovided, but does not limit the flow/direction of data or instructions.The elements included in the electronic device 100 may have variouselectrical/operative connection relationships.

FIG. 3 illustrates an operation of performing image stabilizationaccording to whether an object is detected in an electronic device. Theembodiments described in FIG. 3 and drawings subsequent thereto may beapplied to capture moving images, as well as to capture still images. Inthe following embodiments, respective operations may be performedsequentially, but not necessarily sequentially. For example, thesequence of the respective operations may vary, and at least twooperations may be performed in parallel.

An operational entity of the flowchart shown in FIG. 3 may be aprocessor (e.g., the processor 210 in FIG. 2 ) or an image signalprocessor (e.g., the image signal processor 240 in FIG. 2 ). Inoperation 310, according to an embodiment, the processor 210 may obtainimage data from the camera 220.

In an embodiment, the processor 210 may execute a camera application.For example, the processor 210 may obtain a user's input for executing acamera application. The user's input may include at least one oftouching an icon of the camera application, clicking on a first functionkey 151 or a second function key 152, or inputting a voice such as “OOO,turn on the camera” or “OOO, execute the camera” through AI voicerecognition. The processor 210 may execute the camera application inresponse to at least one of the user's inputs.

In an embodiment, the processor 210 may execute the camera applicationto drive the camera 220. The processor 210 may drive the camera 220 toobtain image data through an image sensor (e.g., the image sensor 1430in FIG. 14 ) in the camera 220. The image data may obtain various colorvalues through a color filter array. The color filter array may includean RGB color filter array. The RGB is only an example, and the colorfilter array may include a color filter array of a Red, Green, Blue, andEmerald (RGBE) pattern, a Cyan, Yellow, And Magenta (CYYM) pattern, aCyan, Yellow, Green, And Magenta (CYGM) pattern, or a Red, Green, Blue,and White (RGBW) pattern.

In operation 320, in an embodiment, the processor 210 may output apreview image for the image data, based on a configured magnification,on the display 110. Outputting the preview image, based on theconfigured magnification, may be mentioned or referred to as a ‘firstmode.’ In other words, the first mode may be a mode in which the imageprocessing is performed with a basic value before a strength of imagestabilization is increased or decreased.

In an embodiment, the processor 210 may display the preview image on thedisplay, based on a reference magnification (e.g., ×1.0 time). Forexample, if the camera application is executed, the processor 210 maydisplay the preview image on at least a portion of the display 110,based on the reference magnification (e.g., ×1.0 time).

In an embodiment, the processor 210 may crop some of the obtained imagedata, thereby determining the area to be output as the preview image. Inresponse to a zoom input (e.g., ×1.5 times) from the user, the processor210 may crop the image data corresponding to the zoom input, therebydetermining the area to be output as the preview image. The processor210 may upsize the determined area and output the same (the upsizedarea) as the preview image on the display 110.

In operation 330, in an embodiment, the processor 210 may detect atleast one object included in the preview image in a state in which theconfigured magnification is greater than the reference magnification.Here, the magnification that is greater than the reference magnificationmay be a high magnification (e.g., ×5.0 times or more) and/or anultra-high magnification (e.g. ×50.0 times or more). Here, detecting theobject may include selecting an object shown in the preview image by theuser, as well as detecting the object by the processor 210 by using anobject detection function and analyzing the image data.

In an embodiment, the processor 210 may detect at least one objectthrough the camera 220. The processor 210 may analyze the image dataobtained by the camera 220, thereby detecting at least one object byusing the object detection function. The object detection may includedetecting an object by the division technique (e.g., segmentation)and/or the edge detection method.

Alternatively, the processor 210 may determine an object, based on dataobtained via machine learning and/or deep learning. For example, theprocessor 210 may detect a crescent moon in the dark night sky through afunction (e.g., a scene optimizer) of the electronic device 100. In acase of photographing the dark night sky, the processor 210 maydetermine an object (e.g., the moon) in consideration of the averageshape of the object (e.g., the moon), the average color of the object(e.g., the moon), or the like.

In an embodiment, the processor 210 may detect an object in response toa user's input of selecting the object displayed in the preview image.The user's input may be a user's input through at least a touch on thedisplay. The processor 210 may display the AF on the object displayed inthe preview image and, in response to a user's input of selecting theAF, detect the object.

In operation 340, in an embodiment, the processor 210 may stabilize thepreview image, based on whether at least one object is detected. Theprocessor 210 may control the strength of image stabilization inresponse to a detection of at least one object. For example, if at leastone object is detected, the processor 210 may increase the strength ofimage stabilization, for example, in order to stably photograph orcapture the detected object. The state in which the strength of imagestabilization is increased may be mentioned or referred to as a ‘secondmode’ in this document. In other words, the second mode may be a mode inwhich image processing is performed by increasing the strength of imagestabilization in response to detection of the object.

In an embodiment, if the object fails to be detected from the previewimage in the state in which the configured magnification is greater thanthe reference magnification, the processor 210 may operate in the ‘firstmode.’

FIG. 4 illustrates an operation of changing a parameter value related toan image stabilization according to whether object detection satisfiespredetermined conditions in an electronic device. In the followingembodiment, respective operations may be performed sequentially, but notnecessarily sequentially. For example, the sequence of the respectiveoperations may vary, and at least two operations may be performed inparallel. An operational entity of the flowchart shown in FIG. 4 may bea processor (e.g., the processor 210 in FIG. 2 ) or an image signalprocessor (e.g., the image signal processor 240 in FIG. 2 ).

In operation 410, in an embodiment, the processor 210 may output apreview image of an image data, based on a configured magnification, onthe display 110. Operation 410 may correspond to operation 320 in FIG. 3.

In operation 420, in an embodiment, the processor 210 may perform astabilization by configuring a parameter value related to an imagestabilization as a first value. The processor 210 may perform thestabilization while maintaining the parameter value related to the imagestabilization at a default value in a normal photographing mode.

In operation 430, in an embodiment, the processor 210 may determinewhether at least one object is detected within a specified area of thepreview image for a predetermined time. For example, the processor 210may identify whether certain conditions are satisfied in order todetermine whether the user has an intention of photographing the objectdetected in the preview image. For example, if the object iscontinuously detected during N frames, the processor 210 may change theparameter related to the image stabilization and output a stable previewimage. As another example, if the object is not continuously detectedduring N frames, the processor 210 may not change the parameter relatedto the image stabilization. For example, the predetermined time may becalculated in units of frames or units of seconds.

In an embodiment, the processor 210 may determine whether the detectedobject is detected within a specified area, based on a central point ofthe detected object. For example, the processor 210 may determinewhether the central point of the detected object falls within a certainratio (e.g., 50%) of the preview image. The processor 210 may performoperation 440 if at least one object is detected within the specifiedarea in the preview image for a predetermined time but, otherwise,perform operation 420.

In operation 440, in an embodiment, the processor 210 may change theparameter value related to image stabilization to a second value, whichis different from the first value, and then perform a stabilization. Thesecond value may be greater than the first value. For example, theprocessor 210 may minimize noise corresponding to shaking by increasingthe coefficient of a low-pass filter. The low-pass filter may bedisposed in a path through which the processor 210 obtains the imagedata from the image sensor of the camera 220.

FIG. 5 illustrates an operation of adjusting the strength of imagestabilization according to whether a trigger event related to imagestabilization occurs in an electronic device. In the followingembodiment, respective operations may be performed sequentially, but notnecessarily sequentially. For example, the sequence of the respectiveoperations may vary, and at least two operations may be performed inparallel. An operational entity of the flowchart shown in FIG. 5 may bea processor (e.g., the processor 210 in FIG. 2 ) or an image signalprocessor (e.g., the image signal processor 240 in FIG. 2 ).

In operation 510, in an embodiment, the processor 210 may output apreview image of the obtained image data on the display 110. This maycorrespond to operation 320 in FIG. 3 .

In operation 520, in an embodiment, the processor 210 may determine amargin area for image stabilization, based on an obtained zoommagnification. The margin area may be a difference between an inputimage obtained by the camera 220 and an output image to be output as thepreview image. The margin area will be further described with referenceto FIG. 9 below.

In operation 530, in an embodiment, the processor 210 may determinewhether a first trigger event occurs. The first trigger may be mentionedor referred to as a ‘zoom lock trigger’ or a ‘FOV locking up trigger.’The zoom lock trigger may indicate an event causing the electronicdevice 100 to perform the image stabilization function in order tostabilize the field of view of an output image.

In an embodiment, the zoom lock trigger may include at least one of auser's display touch input, a user's button input, a user's voice input,or object detection. The user's display touch input may include a casein which the user touches an object that the user wishes to photograph.Touching the object to be photographed may be used in common with the AFfunction. For example, touching the object may include a user's input oftouching the AF in a case where the AF for the object is displayed. Theuser's voice input may include inputting a voice such as “OOO, do notmove the camera” or “OOO, increase camera shaking strength,” forexample, through AI voice recognition.

In an embodiment, the zoom lock trigger may be performed based on achange in a state (e.g., an unfolded state or an extended state) of theelectronic device 100. For example, based on a change in which thedisplay 110 (e.g., the flexible display) is unfolded or extended, theelectronic device 100 may display a preview image corresponding to azoom lock trigger, a user interface (e.g., the user interface 1210 inFIG. 12 ) showing an area cropped from raw image data, and/or ahighlight (e.g., the highlight 1220 in FIG. 12 ) in the extended displayarea (e.g., a screen display area).

In an embodiment, the processor 210 may perform operation 540 if thefirst trigger event occurs but, otherwise, perform operation 510. In anembodiment, the zoom lock trigger may include detecting an object (e.g.,the moon) to be photographed.

In operation 540, in an embodiment, the processor 210 may increase thestrength of image stabilization. The processor 210 may increase thestrength of image stabilization in response to the occurrence of thefirst trigger event.

In operation 550, in an embodiment, the processor 210 may output animage obtained by performing image stabilization on the display 110. Theprocessor 210 may perform stabilization, based on the strength of imagestabilization increased in operation 540. The processor 210 may output apreview image resulting from the image stabilization on the display 110.

In operation 560, in an embodiment, the processor 210 may determinewhether a second trigger event occurs. The second trigger may bementioned or referred to as a ‘zoom unlock trigger’ or a ‘FOV movingtrigger.’ The zoom unlock trigger may indicate an event causing theelectronic device 100 to stop the image stabilization function or reducethe strength of the image stabilization function, so that the FOV of anoutput image moves (is not locked up).

In an embodiment, the zoom unlock trigger may include a display touchinput and a button input by the user in the second mode in which zoomingis locked. If an input of touching an object being photographed and/or abutton input (e.g., a zoom unlock button) is obtained in the second modein which zooming is locked, the processor 210 may recognize the same asa zoom unlock trigger.

In an embodiment, the zoom unlock trigger may include a case where theobject (that was detected in a previous time instance) is no longerdetected in the second mode in which zooming is locked. For example, ifthe object being detected falls outside of the preview image, theprocessor 210 may recognize this as a zoom unlock trigger. If the imagedata obtained by the camera 220 is analyzed and if the object of theimage data is not detected from the image data, the processor 210 maythis as a zoom unlock trigger.

In an embodiment, the zoom unlock trigger may include a case in whichthere is no more stabilization margin to be stabilized in the secondmode in which zooming is locked. In other words, the zoom unlock triggermay include a case in which a preview image of the current frame fallsoutside of the margin area determined at a time at which the firsttrigger event occurs.

In an embodiment, the zoom unlock trigger may be performed based on achange in a state (e.g., a folded state or a reduced state) of theelectronic device 100. For example, based on a change in which thedisplay 110 (e.g., the flexible display) is folded or reduced, theelectronic device 100 may display a preview image corresponding to azoom unlock trigger and/or a user interface (e.g., the user interface1210 in FIG. 12 ) showing an area cropped from raw image data in thereduced display area (e.g., a screen display area).

In an embodiment, the zoom unlock trigger may include a case in whichthe processor 210 analyzes a movement of the electronic device 100 anddetects the movement greater than or equal to a threshold speed in thesecond mode in which zooming is locked. A description related to thiswill be further made with reference to FIG. 10 .

In an embodiment, the processor 210 may perform operation 570 if asecond trigger event occurs but, otherwise, perform operation 550. Inoperation 570, in an embodiment, the processor 210 may performstabilization while reducing the strength of stabilization. Theprocessor 210 may gradually reduce the strength of stabilization. Forexample, the processor 210 may reduce to a reference value during afirst time. The processor 210 may output a preview image resulting fromthe image stabilization for each frame while reducing the strength ofimage stabilization. For example, a state of gradually reducing thestrength of stabilization may be mentioned or referred to as a ‘thirdmode’ in one or more embodiments of this document.

In operation 580, in an embodiment, the processor 210 may determinewhether the strength of stabilization is lower than a reference value.The processor 210 may determine whether the strength of stabilization islower than a reference value. The processor 210 may gradually reduce thestrength of stabilization until the strength of image stabilization isreduced to the reference value.

In an embodiment, the processor 210 may perform operation 590 if thestrength of stabilization is lower than the reference value but,otherwise, perform operation 570. In operation 590, in an embodiment,the processor 210 may output a preview image of obtained image data onthe display 110. If the strength of image stabilization is reduced tothe reference value in response to a zoom unlock trigger event (e.g.,the second trigger event), the processor 210 may display a preview imageobtained by performing image stabilization corresponding to thereference value on the display 110.

FIG. 6 illustrates a graph in which the strength of image stabilizationchanges depending on whether a trigger event related to the imagestabilization occurs in an electronic device. In FIG. 6 , the graphillustrates the strength of image stabilization described in FIG. 5 .The strength of image stabilization, a first trigger event, and a secondtrigger event illustrated in FIG. 6 are the same as those in FIG. 5 .

In an embodiment, if a first trigger event occurs, the processor 210 mayincrease the strength of image stabilization to a maximum value. Thefirst trigger event may be mentioned or referred to as a ‘lock trigger.’The processor 210 may maintain the strength of image stabilization at aminimum level until the first trigger event occurs and increase thestrength of image stabilization to a maximum level in response to thefirst trigger event, thereby outputting a preview image in which theshaking is minimized.

In an embodiment, if a second trigger event occurs, the processor 210may reduce the strength of image stabilization to a minimum value. Thesecond trigger event may be mentioned or referred to as an ‘unlocktrigger.’

FIG. 7 illustrates a user interface related to a trigger event ofincreasing the strength of image stabilization in an electronic device.In FIG. 7 , when executing an application, the processor 210 may outputa user interface, such as a screen 701, to the display 110 of theelectronic device 100.

In an embodiment, the user interface of the application may include afirst area 710 in which a photographing icon 711, a camera switchingicon 712, a recent image icon 713 are disposed. In an embodiment, theicons may be replaced with terms such as buttons, menus, objects, or thelike. In addition, the icons shown in the first area 710 in FIG. 7 areexemplary, and four or more icons may be disposed, or some icons may bereplaced by others or omitted.

In an embodiment, the user interface may include a second area 720showing various photographing modes supported by the application, suchas a photo taking, a video recording, a slow motion recording, and/orthe currently selected photographing mode. The user may change thephotographing mode through a specified input. For example, although thescreen 701 shows the photo taking mode, if a user's input of sliding thedisplay 110 from the right to the left is detected, the processor 210may change the photographing mode to the video recording mode. Theelectronic device 100 may support three or more photographing modes, andvarious photographing modes may be switched through a user's input anddisplayed in the second area 720 as described above.

In an embodiment, the user interface may include a third area 730displaying an image that is photographed, such as a preview image.However, a preview image or a real-time captured image may be outputover another area, as well as over the third area 730. For example, ifthe electronic device 100 starts recording a video, the items displayedin the second area 720 or a fourth area 740 may not be required to beexposed to the user until the recording ends, so the real-time capturedimage may be output to the area including the second area 720 or thefourth area 740 in addition to the third area 730. In addition, thereal-time captured image may be extended to the first area 710. Someicons may remain to be displayed so as to be superimposed on thereal-time captured image.

In an embodiment, the user interface may include a fourth area 740 inwhich setting menus capable of configuring the settings, the flash, orthe aspect ratio are displayed. Parameters included in configurationinformation may be configured via the fourth area 740. For example, theuser may configure a resolution, a frame rate, a filter, or an aspectratio of a video to be recorded by selecting setting icons included inthe fourth area or selecting an aspect ratio icon.

In an embodiment, the processor 210 may display a user interface 750showing the area to be cropped on the display 110. The user interface750 may be mentioned or referred to as a ‘zoom map.’ In an embodiment,the processor 210 may display the zoom map on the display 110 forspecific zoom magnifications. For example, the processor 210 may notdisplay the zoom map for a first zoom magnification (e.g., a zoommagnification of ×1 times) but, if a zoom input greater than or equal toa second zoom magnification (e.g., a zoom magnification of ×10 times) isobtained, the zoom map is on the display 110.

In an embodiment, the processor 210 may display the zoom map, based onan optical zoom input and a digital zoom input. For example, if a user'sinput for zoom-in is obtained after obtaining image data of a specificzoom magnification through an optical zoom, the processor 210 may cropat least a portion of the image of the specific zoom magnification. Theprocessor 210 may provide information about the ratio of the area ofwhich at least the portion is cropped to the image data of the specificzoom magnification through the zoom map. For example, if the ratio is1:10, the processor 210 may display the zoom map as; cropped area:zoommap area=1:10.

In an embodiment, the processor 210 may adjust the size of the croppedarea displayed on the zoom map, based on a zoom magnification. Forexample, in a case of a first magnification (e.g., a maximum zoommagnification), the processor 210 may display the cropped area on thezoom map, which has a first size (e.g., a minimum size). In a case of amagnification (e.g., a second magnification) less than the firstmagnification (e.g., a maximum zoom magnification), the processor 210may display the cropped area on the zoom map, which has a size (e.g., asecond size) greater than the first size (e.g., a minimum size).

In an embodiment, although FIG. 7 illustrates that an object shown inthe preview image is displayed on the zoom map, the processor 210 maydisplay the cropped area on the zoom map and may not display the object.

Although it is illustrated in the embodiment of FIG. 7 that the firstarea 710, the second area 720, the third area 730, and the fourth area740 remain in the screens 701, 702, and 703. Some areas may be omittedor modified before/after starting photographing, during the switchingoperation of the camera or other similar operations.

In an embodiment, the above descriptions of the first area 710, thesecond area 720, the third area 730, the fourth area 740, and the userinterface 750 may be equally applied to the screens 801, 802, and 803 inthe embodiment of FIG. 8 and the screens 1201, 1202, 1203, and 1204 inthe embodiment of FIG. 12 .

In an embodiment, the screen 701 may be a screen in which an object 741is detected in a case where the zoom magnification is increased to aspecific zoom magnification or more in the photo taking mode after acamera application is executed. For example, the screen 701 may be ascreen in which an object (e.g., the moon) 741 is detected in a state inwhich a zoom-in operation is performed with a specific magnification(e.g., zoom magnification of ×20) or more by a user's input after thephoto taking mode is executed.

If the object 741 is detected, the processor 210 may display an area ofinterest around the object 741 to indicate that the object 741 has beendetected. Displaying the area of interest may be used in common withdisplaying the AF. The processor 210 may increase the strength of imagestabilization in response to detecting the object 741.

In an embodiment, the screen 702 may indicate obtaining a user's input742 for selecting an object 741 shown in the preview image. Theprocessor 210 may increase the strength of image stabilization inresponse to obtaining the user's input 742.

In an embodiment, the screen 703 may indicate obtaining a user's input743 for selecting an item (e.g., an icon of lock and/or a padlock icon)that enables an execution of an image stabilization function from thethird area 730 of the display 110. The processor 210 may increase thestrength of image stabilization in response to obtaining the user'sinput 743 of selecting the item.

FIG. 8 illustrates a user interface related to a trigger event oflowering the strength of image stabilization in an electronic device. Inan embodiment, a screen 801 may indicate a case where an object 810(detected in a photo taking mode) is not detected from a preview imageafter a camera application is executed. If no object 810 is detected inthe preview image, the processor 210 may determine that the object 810is not to be photographed, thereby reducing the strength of imagestabilization.

If a condition, in which the object 810 detected in the preview imagefalls outside thereof to a certain extent or more, is satisfied, theprocessor 210 may determine that the object 810 is not to bephotographed, thereby reducing the strength of image stabilization. Forexample, if the object 810 falls outside of the preview image for afirst time, the processor 210 may reduce the strength of imagestabilization. For example, if the object 810 leaves the preview imageat a first speed, the processor 210 may determine that the user is notphotographing the object, thereby reducing the strength of imagestabilization.

In an embodiment, a screen 802 may indicate obtaining a user's input 820for selecting the object 810 shown in the preview image. In response toobtaining the user's input 820 in a state in which the strength of imagestabilization is increased, the processor 210 may reduce the strength ofimage stabilization.

In an embodiment, a screen 803 may indicate obtaining a user's input 830for selecting an item (e.g., an icon of lock and/or a padlock icon) thatenables an execution of an image stabilization function from the thirdarea (e.g., the third area 730 in FIG. 7 ) of the display 110. Inresponse to obtaining the user's input 830 for selecting the item in thestate in which the strength of image stabilization is increased, theprocessor 210 may reduce the strength of image stabilization.

In an embodiment, the item that enables the execution of the imagestabilization function (e.g., an icon of lock and/or a padlock icon)(hereinafter, a zoom lock icon) is not limited to the illustratedexample and may be changed variously. For example, when switching fromthe first mode to the second mode, the text displayed on the zoom lockicon may vary. For example, it may be displayed as unlock in the firstmode and/or the third mode, and displayed as lock in the second mode. Inaddition, if the image stabilization function is executed, a colorchange indicating that the function is activated may be displayed. Forexample, a dark color (e.g., gray) related to an inactive state may bedisplayed in the first mode and/or the third mode, and a bright color(e.g., white or yellow) related to an active state may be displayed inthe second mode.

FIG. 9 illustrates a margin area in an electronic device. The processor210 may obtain image data through the camera 220. The processor 210 mayoutput a preview image based on the image data on the display 110. Theprocessor 210 may crop the obtained image data in response to a user'sinput and the processor 210 may output cropped image data, as a previewimage, to the display 110. As shown in FIG. 9 , the processor 210 maycompare the difference in the area between raw image data obtained bythe camera and the preview image. The processor 210 may determine theproduced difference in the area as a margin area.

In FIG. 9 , a first case 910 may indicate that a preview image area isincluded in the obtained image data so that a margin area is secured. Incontrast, a second case 920 may indicate the case where a preview imagefalls outside of the obtained image data so that there is no margin areafor stabilization, which is a case where an unlock trigger event occurs.If the second case 920 occurs, the processor 210 may operate in thethird mode in which the strength of image stabilization is reduced.

FIG. 10 illustrates an operation of changing the strength of imagestabilization by determining a motion of an electronic device. In thefollowing embodiments, respective operations may be performedsequentially, but not necessarily sequentially. For example, thesequence of the respective operations may vary, and at least twooperations may be performed in parallel. An operational entity of theflowchart shown in FIG. 10 may be a processor (e.g., the processor 210in FIG. 2 ) or an image signal processor (e.g., the image signalprocessor 240 in FIG. 2 ).

In operation 1010, in an embodiment, the processor 210 may determine themotion of the electronic device 100. The processor 210 may analyze themotion of the electronic device 100 to determine whether a speed of themotion greater than or equal to a threshold speed is detected. Theprocessor 210 may determine the motion of the electronic device 100using at least one or more sensors (e.g., a motion sensor).

In an embodiment, the electronic device 100 may include at least one ormore of an acceleration sensor, a gyro sensor, and a geomagnetic sensor.The processor 210 may measure azimuth, pitch, and roll values of theelectronic device 100 based on the motion's data obtained from at leastone sensor, thereby determining the motion of the electronic device 100.The motion data may include 3-axis motion data (x1, y1, z1) obtainedfrom the acceleration sensor or 9-axis motion data obtained by using thegyro sensor and/or the geomagnetic sensor.

In an embodiment, the processor 210 may form a virtual coordinate spacebased on the measured azimuth (e.g., yaw, pitch, and/or roll values-) inthe 9-axis motion data. The processor 210 may specify one area of thevirtual coordinate space as a landscape range and specify another areaas a portrait range. For example, if a state of the electronic device100 is included in the landscape range, the processor 210 may determinethat the electronic device 100 is in a landscape state in which theparallel long side of the electronic device 100 is supported in thehorizontal axis that is parallel to the ground. For example, if thestate of the electronic device 100 is included in the portrait range,the processor 210 may determine that the electronic device 100 is in aportrait state in which the parallel long side of the electronic device100 is supported in the vertical axis that is perpendicular to theground.

In an embodiment, the processor 210 may determine the motion of theelectronic device 100 to recognize the user's intention forphotographing. For example, if the motion of the electronic device 100changes rapidly, it may be determined that the user wishes to change theobject to be photographed or stop photographing, thereby reducing thestrength of image stabilization.

In operation 1020, in an embodiment, the processor 210 may determinewhether a speed of the motion of the electronic device 100 is greaterthan or equal to a threshold value (e.g., a threshold speed). Forexample, if the electronic device 100 moves by a first angle (or more)during N frames about a panning axis of the camera 220, the processor210 may determine that the motion is greater than or equal to athreshold value, thereby performing operation 1030. The first angle mayvary depending on the zoom magnification configured for the currentframe and/or the size of an object. In an embodiment, the processor 210may perform operation 1010 if the motion of the electronic device 100 isnot greater than or equal to the threshold value (e.g., a thresholdspeed).

In operation 1030, in an embodiment, the processor 210 may reduce thestrength of image stabilization. Operation 1030 may correspond tooperations 570 to 590 in FIG. 5 .

FIG. 11 illustrates an operation of controlling a display when a triggerevent related to the image stabilization occurs in an electronic device.The operational entity of the flowchart shown in FIG. 11 may be aprocessor (e.g., the processor 210 in FIG. 2 ) or an image signalprocessor (e.g., the image signal processor 240 in FIG. 2 ). FIG. 11 isrelated to the screens shown in FIG. 12 (below).

In operation 1110, in an embodiment, the processor 210 may display, onone area (e.g., the third area 730 in FIG. 7 ) of the display 110, auser interface showing the area to be cropped. If a zoom input isobtained from the user, the processor 210 may display a user interfaceshowing the area to be cropped from obtained raw image data on one areaof the display 110. For example, if a zoom input of ×100 times isobtained from the user, the processor 210 may display image dataobtained by the camera 220 and image data cropped to 1/100 of the imagedata on the display 110.

In operation 1120, in an embodiment, the processor 210 may determinewhether a first trigger event occurs. Operation 1120 may correspond tooperation 530 in FIG. 5 . In an embodiment, the processor 210 mayperform operation 1130 if the first trigger event occurs and, otherwise,the processor 210 may perform operation 1110.

In operation 1130, in an embodiment, the processor 210 may display ahighlight on the user interface. The processor 210 may display thehighlight on the user interface in response to the occurrence of thefirst trigger event. The processor 210 may display the highlight on theuser interface, thereby providing a notification indicating an increasein the strength of image stabilization to the user.

In operation 1140, in an embodiment, the processor 210 may determinewhether a second trigger event occurs. Operation 1140 may correspond tooperation 560 in FIG. 5 . In an embodiment, the processor 210 mayperform operation 1150 if the second trigger event occurs and,otherwise, the processor 210 may perform operation 1130.

In operation 1150, in an embodiment, the processor 210 may release thehighlight display from the user interface. The processor 210 may releasethe highlight display from the user interface in response to theoccurrence of the second trigger event. The processor 210 may releasethe highlight display, thereby providing a notification indicating areduction in the strength of image stabilization to the user.

FIG. 12 illustrates that a display varies on the display as a triggerevent related to the image stabilization occurs in an electronic device.FIG. 12 shows a user interface output on the display 110 in relation tothe description of FIG. 11 .

A screen 1201, in an embodiment, may be a screen in which a previewimage is output on the display 110, basically based on a configuredmagnification (e.g., a magnification of ×1.0 time). For example, theprocessor 210 may output a preview image including an object (e.g., themoon) at a zoom magnification of ×1.0, on the display 110.

A screen 1202, in an embodiment, may be a screen corresponding tooperation 1110 in FIG. 11 . The screen 1202 may be a screen in which theprocessor 210, in response to obtaining a zoom input (e.g., ×100 times)from the user in the state of the screen 1201, outputs a preview imagecorresponding to the zoom input. If a zoom input is obtained from theuser, the processor 210 may display a user interface 1210 showing thearea to be cropped from obtained raw image data on one area of thedisplay 110.

A screen 1203, in an embodiment, may correspond to operation 1130 inFIG. 11 . In the screen 1203, the processor 210 may display a highlight1220 on the user interface 1210 showing the area to be cropped. Forexample, the processor 210 may display at least the outer line of theuser interface 1210 in yellow and bold type.

In an embodiment, a specific icon may be displayed on one area (e.g.,the third area 730 in FIG. 7 ) of the display 110 in addition to thehighlighting method shown in the screen 1203. For example, if a firsttrigger event occurs while photographing with a high magnification(e.g., zoom magnification of ×10 times or higher), the processor 210 maydisplay a lock icon indicating that the preview is locked up withoutshaking.

In an embodiment, a current mode (e.g., a lock mode) may be displayed onone area (e.g., the second area 720 in FIG. 7 ) of the display 110 inaddition to the highlighting method shown in the screen 1203. Forexample, if a first trigger event occurs while photographing with a highmagnification (e.g., zoom magnification of ×100 times) in the photomode, the processor 210 may change the display of the photo mode into adisplay of a lock mode in one area (e.g., the second area 720 in FIG. 7) of the display 110.

A screen 1204, in an embodiment, may corresponding to operation 1150 inFIG. 11 . The processor 210 may release the highlight and output thepreview image on the screen 1202.

FIG. 13 illustrates an electronic device 1301 in a network environment1300 according to one or more embodiments. In FIG. 13 , the electronicdevice 1301 in the network environment 1300 may communicate with anelectronic device 1302 via a first network 1398 (e.g., a short-rangewireless communication network), or at least one of an electronic device1304 or a server 1308 via a second network 1399 (e.g., a long-rangewireless communication network). In an embodiment, the electronic device1301 may communicate with the electronic device 1304 via the server1308. In an embodiment, the electronic device 1301 may include aprocessor 1320, memory 1330, an input module 1350, a sound output module1355, a display module 1360, an audio module 1370, a sensor module 1376,an interface 1377, a connecting terminal 1378, a haptic module 1379, acamera module 1380, a power management module 1388, a battery 1389, acommunication module 1390, a Subscriber Identification Module (SIM)1396, or an antenna module 1397. In some embodiments, at least one ofthe components (e.g., the connecting terminal 1378) may be omitted fromthe electronic device 1301, or one or more other components may be addedin the electronic device 1301. In some embodiments, some of thecomponents (e.g., the sensor module 1376, the camera module 1380, or theantenna module 1397) may be implemented as a single component (e.g., thedisplay module 1360).

The processor 1320 may execute, for example, software (e.g., a program1340) to control at least one other component (e.g., a hardware orsoftware component) of the electronic device 1301 coupled with theprocessor 1320, and may perform various data processing or computation.According to one embodiment, as at least part of the data processing orcomputation, the processor 1320 may store a command or data receivedfrom another component (e.g., the sensor module 1376 or thecommunication module 1390) in volatile memory 1332, process the commandor the data stored in the volatile memory 1332, and store resulting datain non-volatile memory 1334. In an embodiment, the processor 1320 mayinclude a main processor 1321 (e.g., a Central Processing Unit (CPU) oran Application Processor (AP)), or an auxiliary processor 1323 (e.g., aGraphics Processing Unit (GPU), a Neural Processing Unit (NPU), an ImageSignal Processor (ISP), a sensor hub processor, or a CommunicationProcessor (CP)) that is operable independently from, or in conjunctionwith, the main processor 1321. For example, when the electronic device1301 includes the main processor 1321 and the auxiliary processor 1323,the auxiliary processor 1323 may be adapted to consume less power thanthe main processor 1321, or to be specific to a specified function. Theauxiliary processor 1323 may be implemented as separate from, or as partof the main processor 1321.

The auxiliary processor 1323 may control at least some of functions orstates related to at least one component (e.g., the display module 1360,the sensor module 1376, or the communication module 1390) among thecomponents of the electronic device 1301, instead of the main processor1321 while the main processor 1321 is in an inactive (e.g., sleep)state, or together with the main processor 1321 while the main processor1321 is in an active state (e.g., executing an application).

In an embodiment, the auxiliary processor 1323 (e.g., an image signalprocessor or a communication processor) may be implemented as part ofanother component (e.g., the camera module 1380 or the communicationmodule 1390) functionally related to the auxiliary processor 1323. In anembodiment, the auxiliary processor 1323 (e.g., the neural processingunit) may include a hardware structure specified for AI modelprocessing. An AI model may be generated by machine learning. Suchlearning may be performed, e.g., by the electronic device 1301 where theAI is performed or via a separate server (e.g., the server 1308).

Learning algorithms may include, but are not limited to, e.g.,supervised learning, unsupervised learning, semi-supervised learning, orreinforcement learning. The AI model may include a plurality ofartificial neural network layers. The artificial neural network may be aDeep Neural Network (DNN), a Convolutional Neural Network (CNN), aRecurrent Neural Network (RNN), a Restricted Boltzmann Machine (RBM), aDeep Belief Network (DBN), a Bidirectional Recurrent Deep Neural Network(BRDNN), deep Q-network or a combination of two or more thereof but isnot limited thereto. The AI model may, additionally or alternatively,include a software structure other than the hardware structure.

The memory 1330 may store various data used by at least one component(e.g., the processor 1320 or the sensor module 1376) of the electronicdevice 1301. The various data may include, for example, software (e.g.,the program 1340) and input data or output data for a command related tothe data. The memory 1330 may include the volatile memory 1332 or thenon-volatile memory 1334.

The program 1340 may be stored in the memory 1330 as software, and mayinclude, for example, an Operating System (OS) 1342, middleware 1344, oran application 1346.

The input module 1350 may receive a command or data to be used byanother component (e.g., the processor 1320) of the electronic device1301, from the outside (e.g., a user) of the electronic device 1301. Theinput module 1350 may include, for example, a microphone, a mouse, akeyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

The sound output module 1355 may output sound signals to the outside ofthe electronic device 1301. The sound output module 1355 may include,for example, a speaker or a receiver. The speaker may be used forgeneral purposes, such as playing multimedia or playing record. Thereceiver may be used for receiving incoming calls. In an embodiment, thereceiver may be implemented as separate from, or as part of the speaker.

The display module 1360 may visually provide information to the outside(e.g., a user) of the electronic device 1301. The display module 1360may include, for example, a display, a hologram device, or a projectorand control circuitry to control a corresponding one of the display,hologram device, and projector. In an embodiment, the display module1360 may include a touch sensor adapted to detect a touch, or a pressuresensor adapted to measure the intensity of force incurred by the touch.

The audio module 1370 may convert a sound into an electrical signal andvice versa. In an embodiment, the audio module 1370 may obtain the soundvia the input module 1350, or output the sound via the sound outputmodule 1355 or a headphone of an external electronic device (e.g., anelectronic device 1302) directly (e.g., wiredly) or wirelessly coupledwith the electronic device 1301.

The sensor module 1376 may detect an operational state (e.g., power ortemperature) of the electronic device 1301 or an environmental state(e.g., a state of a user) external to the electronic device 1301, andthen generate an electrical signal or data value corresponding to thedetected state. In an embodiment, the sensor module 1376 may include,for example, a gesture sensor, a gyro sensor, an atmospheric pressuresensor, a magnetic sensor, an acceleration sensor, a grip sensor, aproximity sensor, a color sensor, an infrared (IR) sensor, a biometricsensor, a temperature sensor, a humidity sensor, or an illuminancesensor.

The interface 1377 may support one or more specified protocols to beused for the electronic device 1301 to be coupled with the externalelectronic device (e.g., the electronic device 1302) directly (e.g.,wiredly) or wirelessly. In an embodiment, the interface 1377 mayinclude, for example, a High Definition Multimedia Interface (HDMI), aUniversal Serial Bus (USB) interface, a Secure Digital (SD) cardinterface, or an audio interface.

A connecting terminal 1378 may include a connector via which theelectronic device 1301 may be physically connected with the externalelectronic device (e.g., the electronic device 1302). In an embodiment,the connecting terminal 1378 may include, for example, a HDMI connector,a USB connector, a SD card connector, or an audio connector (e.g., aheadphone connector).

The haptic module 1379 may convert an electrical signal into amechanical stimulus (e.g., a vibration or a movement) or electricalstimulus which may be recognized by a user via his tactile sensation orkinesthetic sensation. In an embodiment, the haptic module 1379 mayinclude, for example, a motor, a piezoelectric element, or an electricstimulator.

The camera module 1380 may capture a still image or moving images. In anembodiment, the camera module 1380 may include one or more lenses, imagesensors, image signal processors, or flashes.

The power management module 1388 may manage power supplied to theelectronic device 1301. According to one embodiment, the powermanagement module 1388 may be implemented as at least part of, forexample, a power management integrated circuit (PMIC).

The battery 1389 may supply power to at least one component of theelectronic device 1301. In an embodiment, the battery 1389 may include,for example, a primary cell which is not rechargeable, a secondary cellwhich is rechargeable, or a fuel cell.

The communication module 1390 may support establishing a direct (e.g.,wired) communication channel or a wireless communication channel betweenthe electronic device 1301 and the external electronic device (e.g., theelectronic device 1302, the electronic device 1304, or the server 1308)and performing communication via the established communication channel.The communication module 1390 may include one or more communicationprocessors that are operable independently from the processor 1320(e.g., the application processor (AP)) and supports a direct (e.g.,wired) communication or a wireless communication. In an embodiment, thecommunication module 1390 may include a wireless communication module1392 (e.g., a cellular communication module, a short-range wirelesscommunication module, or a Global Navigation Satellite System (GNSS)communication module) or a wired communication module 1394 (e.g., aLocal Area Network (LAN) communication module or a Power LineCommunication (PLC) module). A corresponding one of these communicationmodules may communicate with the external electronic device via thefirst network 1398 (e.g., a short-range communication network, such asBluetooth™, wireless-fidelity (Wi-Fi) direct, or infrared dataassociation (IrDA)) or the second network 1399 (e.g., a long-rangecommunication network, such as a legacy cellular network, a 5G network,a next-generation communication network, the Internet, or a computernetwork (e.g., LAN or Wide Area Network (WAN)). These various types ofcommunication modules may be implemented as a single component (e.g., asingle chip), or may be implemented as multi components (e.g., multichips) separate from each other. The wireless communication module 1392may identify and authenticate the electronic device 1301 in acommunication network, such as the first network 1398 or the secondnetwork 1399, using subscriber information (e.g., International MobileSubscriber Identity (IMSI)) stored in the SIM 1396.

The wireless communication module 1392 may support a 5G network, after a4G network, and next-generation communication technology, e.g., NewRadio (NR) access technology. The NR access technology may supportenhanced Mobile Broadband (eMBB), massive Machine Type Communications(mMTC), or Ultra-Reliable and Low-Latency Communications (URLLC). Thewireless communication module 1392 may support a high-frequency band(e.g., the mmWave band) to achieve, e.g., a high data transmission rate.The wireless communication module 1392 may support various technologiesfor securing performance on a high-frequency band, such as, e.g.,beamforming, massive Multiple-Input and Multiple-Output (massive MIMO),full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, orlarge scale antenna. The wireless communication module 1392 may supportvarious requirements specified in the electronic device 1301, anexternal electronic device (e.g., the electronic device 1304), or anetwork system (e.g., the second network 1399). In an embodiment, thewireless communication module 1392 may support a peak data rate (e.g.,20 Gbps or more) for implementing eMBB, loss coverage (e.g., 164 dB orless) for implementing mMTC, or U-plane latency (e.g., 0.5 ms or lessfor each of downlink (DL) and uplink (UL), or a round trip of lms orless) for implementing URLLC.

The antenna module 1397 may transmit or receive a signal or power to orfrom the outside (e.g., the external electronic device) of theelectronic device 1301. In an embodiment, the antenna module 1397 mayinclude an antenna including a radiating element composed of aconductive material or a conductive pattern formed in or on a substrate(e.g., a Printed Circuit Board (PCB)). In an embodiment, the antennamodule 1397 may include a plurality of antennas (e.g., array antennas).In such a case, at least one antenna appropriate for a communicationscheme used in the communication network, such as the first network 1398or the second network 1399, may be selected, for example, by thecommunication module 1390 (e.g., the wireless communication module 1392)from the plurality of antennas. The signal or the power may then betransmitted or received between the communication module 1390 and theexternal electronic device via the selected at least one antenna. In anembodiment, another component (e.g., a radio frequency integratedcircuit (RFIC)) other than the radiating element may be additionallyformed as part of the antenna module 1397.

According to one or more embodiments, the antenna module 1397 may form ammWave antenna module. In an embodiment, the mmWave antenna module mayinclude a printed circuit board, a RFIC disposed on a first surface(e.g., the bottom surface) of the printed circuit board, or adjacent tothe first surface and capable of supporting a designated high-frequencyband (e.g., the mmWave band), and a plurality of antennas (e.g., arrayantennas) disposed on a second surface (e.g., the top or a side surface)of the printed circuit board, or adjacent to the second surface andcapable of transmitting or receiving signals of the designatedhigh-frequency band.

At least some of the above-described components may be coupled mutuallyand communicate signals (e.g., commands or data) therebetween via aninter-peripheral communication scheme (e.g., a bus, General PurposeInput and Output (GPIO), Serial Peripheral Interface (SPI), or MobileIndustry Processor Interface (MIPI)).

In an embodiment, commands or data may be transmitted or receivedbetween the electronic device 1301 and the external electronic device1304 via the server 1308 coupled with the second network 1399. Each ofthe electronic devices 1302 or 1304 may be a device of a same type as,or a different type, from the electronic device 1301. In an embodiment,all or some of operations to be executed at the electronic device 1301may be executed at one or more of the external electronic devices 1302,1304, or 1308.

For example, if the electronic device 1301 should perform a function ora service automatically, or in response to a request from a user oranother device, the electronic device 1301, instead of, or in additionto, executing the function or the service, may request the one or moreexternal electronic devices to perform at least part of the function orthe service. The one or more external electronic devices receiving therequest may perform the at least part of the function or the servicerequested, or an additional function or an additional service related tothe request, and transfer an outcome of the performing to the electronicdevice 1301. The electronic device 1301 may provide the outcome, with orwithout further processing of the outcome, as at least part of a replyto the request. To that end, a cloud computing, distributed computing,mobile edge computing (MEC), or client-server computing technology maybe used, for example.

The electronic device 1301 may provide ultra low-latency services using,e.g., distributed computing or mobile edge computing. In anotherembodiment, the external electronic device 1304 may include aninternet-of-things (IoT) device. The server 1308 may be an intelligentserver using machine learning and/or a neural network. In an embodiment,the external electronic device 1304 or the server 1308 may be includedin the second network 1399. The electronic device 1301 may be applied tointelligent services (e.g., smart home, smart city, smart car, orhealthcare) based on 5G communication technology or IoT-relatedtechnology.

The electronic device according to one or more embodiments may be one ofvarious types of electronic devices. The electronic devices may include,for example, a portable communication device (e.g., a smartphone), acomputer device, a portable multimedia device, a portable medicaldevice, a camera, a wearable device, or a home appliance. In anembodiment of the disclosure, the electronic devices are not limited tothose described above.

One or more embodiments of the disclosure and the terms used therein arenot intended to limit the technological features set forth herein toparticular embodiments and include various changes, equivalents, orreplacements for a corresponding embodiment. With regard to thedescription of the drawings, similar reference numerals may be used torefer to similar or related elements. A singular form of a nouncorresponding to an item may include one or more of the things, unlessthe relevant context clearly indicates otherwise. As used herein, eachof such phrases as “A or B,” “at least one of A and B,” “at least one ofA or B,” “A, B, or C,” “at least one of A, B, and C,” and “at least oneof A, B, or C,” may include any one of, or all possible combinations ofthe items enumerated together in a corresponding one of the phrases. Asused herein, such terms as “1st” and “2nd,” or “first” and “second” maybe used to simply distinguish a corresponding component from another,and does not limit the components in other aspect (e.g., importance ororder). If an element (e.g., a first element) is referred to, with orwithout the term “operatively” or “communicatively”, as “coupled with,”“coupled to,” “connected with,” or “connected to” another element (e.g.,a second element), it means that the element may be coupled with theother element directly (e.g., wiredly), wirelessly, or via a thirdelement.

As used in connection with one or more embodiments of the disclosure,the term “module” may include a unit implemented in hardware, software,or firmware, and may interchangeably be used with other terms, forexample, “logic,” “logic block,” “part,” or “circuitry”. A module may bea single integral component, or a minimum unit or part thereof, adaptedto perform one or more functions. For example, in an embodiment, themodule may be implemented in a form of an Application-SpecificIntegrated Circuit (ASIC).

One or more embodiments as set forth herein may be implemented assoftware (e.g., the program 1340) including one or more instructionsthat are stored in a storage medium (e.g., internal memory 1336 orexternal memory 1338) that is readable by a machine (e.g., theelectronic device 1301). For example, a processor (e.g., the processor1320) of the machine (e.g., the electronic device 1301) may invoke atleast one of the one or more instructions stored in the storage medium,and execute it, with or without using one or more other components underthe control of the processor. This allows the machine to be operated toperform at least one function according to the at least one instructioninvoked. The one or more instructions may include a code generated by acomplier or a code executable by an interpreter. The machine-readablestorage medium may be provided in the form of a non-transitory storagemedium. Wherein, the term “non-transitory” simply means that the storagemedium is a tangible device, and does not include a signal (e.g., anelectromagnetic wave), but this term does not differentiate betweenwhere data is semi-permanently stored in the storage medium and wherethe data is temporarily stored in the storage medium.

In an embodiment, a method according to one or more embodiments of thedisclosure may be included and provided in a computer program product.The computer program product may be traded as a product between a sellerand a buyer. The computer program product may be distributed in the formof a machine-readable storage medium (e.g., compact disc read onlymemory (CD-ROM)), or be distributed (e.g., downloaded or uploaded)online via an application store (e.g., PlayStore™), or between two userdevices (e.g., smart phones) directly. If distributed online, at leastpart of the computer program product may be temporarily generated or atleast temporarily stored in the machine-readable storage medium, such asmemory of the manufacturer's server, a server of the application store,or a relay server.

According to one or more embodiments, each component (e.g., a module ora program) of the above-described components may include a single entityor multiple entities, and some of the multiple entities may beseparately disposed in different components. According to one or moreembodiments, one or more of the above-described components may beomitted, or one or more other components may be added. Alternatively oradditionally, a plurality of components (e.g., modules or programs) maybe integrated into a single component. In such a case, according to oneor more embodiments, the integrated component may still perform one ormore functions of each of the plurality of components in the same orsimilar manner as they are performed by a corresponding one of theplurality of components before the integration. According to one or moreembodiments, operations performed by the module, the program, or anothercomponent may be carried out sequentially, in parallel, repeatedly, orheuristically, or one or more of the operations may be executed in adifferent order or omitted, or one or more other operations may beadded.

FIG. 14 is a block diagram 1400 illustrating the camera module 1380according to one or more embodiments. In FIG. 14 , the camera module1380 may include a lens assembly 1410, a flash 1420, an image sensor1430, an image stabilizer 1440, memory 1450 (e.g., buffer memory), or animage signal processor 1460. The lens assembly 1410 may collect lightemitted or reflected from an object whose image is to be taken. The lensassembly 1410 may include one or more lenses. In an embodiment, thecamera module 1380 may include a plurality of lens assemblies 1410. Insuch a case, the camera module 1380 may form, for example, a dualcamera, a 360-degree camera, or a spherical camera. Some of theplurality of lens assemblies 1410 may have the same lens attribute(e.g., view angle, focal length, auto-focusing, f number, or opticalzoom), or at least one lens assembly may have one or more lensattributes different from those of another lens assembly. The lensassembly 1410 may include, for example, a wide-angle lens or a telephotolens.

The flash 1420 may emit light that is used to reinforce light reflectedfrom an object. In an embodiment, the flash 1420 may include one or morelight emitting diodes (LEDs) (e.g., a red-green-blue (RGB) LED, a whiteLED, an infrared (IR) LED, or an ultraviolet (UV) LED) or a xenon lamp.The image sensor 1430 may obtain an image corresponding to an object byconverting light emitted or reflected from the object and transmittedvia the lens assembly 1410 into an electrical signal. In an embodiment,the image sensor 1430 may include one selected from image sensors havingdifferent attributes, such as a RGB sensor, a black-and-white (BW)sensor, an IR sensor, or a UV sensor, a plurality of image sensorshaving the same attribute, or a plurality of image sensors havingdifferent attributes. Each image sensor included in the image sensor1430 may be implemented using, for example, a Charged Coupled Device(CCD) sensor or a Complementary Metal Oxide Semiconductor (CMOS) sensor.

The image stabilizer 1440 may move the image sensor 1430 or at least onelens included in the lens assembly 1410 in a particular direction, orcontrol an operational attribute (e.g., adjust the read-out timing) ofthe image sensor 1430 in response to the movement of the camera module1380 or the electronic device 1301 including the camera module 1380.This allows compensating for at least part of a negative effect (e.g.,image blurring) by the movement on an image being captured. In anembodiment, the image stabilizer 1440 may sense such a movement by thecamera module 1380 or the electronic device 1301 using a gyro sensor oran acceleration sensor disposed inside or outside the camera module1380.

In an embodiment, the image stabilizer 1440 may be implemented, forexample, as an optical image stabilizer. The memory 1450 may store, atleast temporarily, at least part of an image obtained via the imagesensor 1430 for a subsequent image processing task. For example, ifimage capturing is delayed due to shutter lag or multiple images arequickly captured, a raw image obtained (e.g., a Bayer-patterned image, ahigh-resolution image) may be stored in the memory 1450, and itscorresponding copy image (e.g., a low-resolution image) may be previewedvia the display module 1360. Thereafter, if a specified condition is met(e.g., by a user's input or system command), at least part of the rawimage stored in the memory 1450 may be obtained and processed, forexample, by the image signal processor 1460. In an embodiment, thememory 1450 may be configured as at least part of the memory 1330 or asa separate memory that is operated independently from the memory 1330.

The image signal processor 1460 may perform one or more image processingwith respect to an image obtained via the image sensor 1430 or an imagestored in the memory 1450. The one or more image processing may include,for example, depth map generation, three-dimensional (3D) modeling,panorama generation, feature point extraction, image synthesizing, orimage compensation (e.g., noise reduction, resolution adjustment,brightness adjustment, blurring, sharpening, or softening).

Additionally or alternatively, the image signal processor 1460 mayperform control (e.g., exposure time control or read-out timing control)with respect to at least one (e.g., the image sensor 1430) of thecomponents included in the camera module 1380. An image processed by theimage signal processor 1460 may be stored back in the memory 1450 forfurther processing, or may be provided to an external component (e.g.,the memory 1330, the display module 1360, the electronic device 1302,the electronic device 1304, or the server 1308) outside the cameramodule 1380. In an embodiment, the image signal processor 1460 may beconfigured as at least part of the processor 1320, or as a separateprocessor that is operated independently from the processor 1320. If theimage signal processor 1460 is configured as a separate processor fromthe processor 1320, at least one image processed by the image signalprocessor 1460 may be displayed, by the processor 1320, via the displaymodule 1360 as it is or after being further processed.

In an embodiment, the electronic device 1301 may include a plurality ofcamera modules 1380 having different attributes or functions. In such acase, at least one of the plurality of camera modules 1380 may form, forexample, a wide-angle camera and at least another of the plurality ofcamera modules 1380 may form a telephoto camera. Similarly, at least oneof the plurality of camera modules 1380 may form, for example, a frontcamera and at least another of the plurality of camera modules 1380 mayform a rear camera.

In an embodiment, an electronic device 100 may include a camera 220, adisplay 110, and at least one processor (e.g., the processor 210 in FIG.2 and/or the image signal processor 240 in FIG. 2 ) electricallyconnected to the camera 220 and the display 110.

In an embodiment, the at least one processor may obtain image data bydriving the camera 220 and output a preview image for the image data onthe display 110, based on a configured magnification. The at least oneprocessor may detect at least one object included in the preview imageobtained by the camera 220 in a state in which the configuredmagnification is greater than a reference magnification and stabilizethe preview image, based on whether the at least one object is detected.

In an embodiment, the at least one processor may increase the strengthof image stabilization by changing a parameter for performing the imagestabilization in response to the detection of the at least one object.

In an embodiment, the at least one processor may increase the strengthof image stabilization in response to maintenance of a state in whichthe at least one object is detected within a specified area in thepreview image for a predetermined time.

In an embodiment, the at least one processor may reduce the strength ofimage stabilization if a trigger event for reducing the strength ofimage stabilization occurs.

In an embodiment, the at least one processor may gradually lower thestrength of image stabilization in response to the trigger event.

In an embodiment, the at least one processor may determine a margin areafor image stabilization in response to a user's zoom input.

In an embodiment, the margin area may be an area obtained by excluding asecond area included in the preview image from a first area included inthe image data.

In an embodiment, the at least one processor may determine motion of theelectronic device using at least one sensor and, if the motion isgreater than or equal to a threshold value, reduce the strength of imagestabilization.

In an embodiment, the trigger event may include at least one ofreceiving a user's input for stopping the image stabilization, the casewhere the at least one object is not included in the image data, or thecase where a preview area falls outside of the margin area.

In an embodiment, the at least one processor may increase the strengthof image stabilization by increasing a coefficient of a low-pass filterincluded in a path for obtaining the image data from an image sensor(e.g., the image sensor 1430 in FIG. 14 ) of the camera 220.

In an embodiment, an operation method of an electronic device 100 mayinclude obtaining image data by driving a camera 220, outputting apreview image of the image data through a display 110, based on aconfigured magnification, detecting at least one object included in thepreview image obtained by the camera 220 in the state in which theconfigured magnification is greater than a reference magnification, andperforming image stabilization on the preview image, based on whetherthe at least one object is detected.

In an embodiment, the operation method of the electronic device 100 mayinclude increasing the strength of image stabilization by changing aparameter for performing the image stabilization in response to thedetection of the at least one object.

In an embodiment, the operation method of the electronic device 100 mayinclude increasing the strength of image stabilization in response tomaintenance of a state in which the at least one object is detectedwithin a specified area in the preview image for a predetermined time.

In an embodiment, the operation method of the electronic device 100 mayinclude gradually reducing the strength of image stabilization if atrigger event for reducing the strength of image stabilization occurs.The trigger event may include at least one of receiving a user's inputfor stopping the image stabilization, the case where the at least oneobject is not included in the image data, or the case where a previewarea falls outside of a margin area.

In an embodiment, the operation method of the electronic device 100 maygradually reduce, if the trigger event occurs, the strength of imagestabilization to a reference value for a predetermined time in responseto the trigger event.

In an embodiment, an electronic device 100 may include a camera 220, adisplay 110, and at least one processor (e.g., the processor 210 in FIG.2 and/or the image signal processor 240 in FIG. 2 ) electricallyconnected to the camera 220 and the display 110. The at least oneprocessor may obtain image data by driving the camera 220, determine amargin area for image stabilization in response to a user's zoom input,and output a preview image for the image data, based on a configuredmagnification, on the display 110. The at least one processor mayincrease the strength of image stabilization in response to a firsttrigger event for increasing the strength of image stabilization in thestate in which the configured magnification is greater than a referencemagnification. If a second trigger event for reducing the strength ofimage stabilization occurs in the state in which the strength of imagestabilization is increased, the at least one processor may reduce thestrength of image stabilization in response to the second trigger event.

In an embodiment, the first trigger event may include detecting at leastone object, and the at least one processor may increase the strength ofimage stabilization in response to maintenance of a state in which theat least one object is detected within a specified area in the previewimage for a predetermined time.

In an embodiment, the at least one processor may gradually reduce thestrength of image stabilization to a reference value for a predeterminedtime in response to the second trigger event.

In an embodiment, the first trigger event may include at least one ofreceiving a user's input for increasing the strength of imagestabilization or the case where at least one object is included in theimage data.

In an embodiment, the second trigger event may include at least one ofreceiving a user's input for stopping the image stabilization, the casewhere the at least one object is not included in the image data, or thecase where a preview area falls outside of the margin area.

What is claimed is:
 1. An electronic device comprising: a camera; adisplay; and at least one processor electrically connected to the cameraand the display, wherein the at least one processor is configured to:obtain an image data from the camera; output a preview image of theimage data on the display, based on a configured magnification; detectat least one object of the preview image in a state in which theconfigured magnification is greater than a reference magnification; andperform an image stabilization on the preview image, based on thedetected at least one object of the preview image.
 2. The electronicdevice of claim 1, wherein the at least one processor is furtherconfigured to increase a strength of the image stabilization by changinga parameter for performing the image stabilization in response to thedetection of the at least one object of the preview image.
 3. Theelectronic device of claim 2, wherein the at least one processor isfurther configured to increase the strength of the image stabilizationin response to a determination that the at least one object is detectedwithin a specified area of the preview image for a predetermined time.4. The electronic device of claim 1, wherein the at least one processoris further configured to reduce a strength of the image stabilization ina case that a trigger event for reducing the strength of the imagestabilization occurs.
 5. The electronic device of claim 4, wherein theat least one processor is further configured to gradually lower thestrength of the image stabilization in response to the trigger event. 6.The electronic device of claim 1, wherein the at least one processor isfurther configured to determine a margin area for the imagestabilization in response to a user's input.
 7. The electronic device ofclaim 6, wherein the margin area is an area obtained by excluding asecond area included in the preview image from a first area included inthe image data.
 8. The electronic device of claim 1, wherein: the atleast one processor is further configured to determine a motion of theelectronic device using at least one sensor, and, wherein, in a casethat the motion is greater than or equal to a threshold value, the atleast one processor is further configured to reduce a strength of imagestabilization.
 9. The electronic device of claim 4, wherein the triggerevent comprises at least one of receiving a user's input for stoppingthe image stabilization, in a first case where the at least one objectis not included in the image data, or in a second case where a previewarea falls outside of a margin area.
 10. The electronic device of claim1, wherein the at least one processor is further configured to increasea strength of the image stabilization by increasing a coefficient of alow-pass filter disposed in a path for obtaining the image data from thecamera.
 11. A method of operating an electronic device, the methodcomprising: obtaining an image data from a camera; outputting a previewimage of the image data on a display, based on a configuredmagnification; detecting at least one object of the preview imageobtained by the camera in a state in which the configured magnificationis greater than a reference magnification; and performing an imagestabilization on the preview image, based on the detected at least oneobject of the preview image.
 12. The method of claim 11, furthercomprising increasing a strength of the image stabilization by changinga parameter for performing the image stabilization in response to thedetection of the at least one object.
 13. The method of claim 12,further comprising increasing a strength of image stabilization inresponse to a determination that the at least one object is detectedwithin a specified area in the preview image for a predetermined time.14. The method of claim 11, further comprising gradually reducing astrength of the image stabilization in a case that a trigger event forreducing the strength of the image stabilization occurs, wherein thetrigger event comprises at least one of receiving a user's input forstopping the image stabilization, in a case where the at least oneobject is not included in the image data, or in a case where a previewarea falls outside of a margin area.
 15. The method of claim 14, furthercomprising, in the case that the trigger event for reducing the strengthof the image stabilization occurs, gradually reducing the strength ofimage stabilization to a reference value for a predetermined time inresponse to the trigger event.
 16. An electronic device comprising: acamera; a display; and at least one processor electrically connected tothe camera and the display, wherein the at least one processor isconfigured to: output a preview image of an image data, based on aconfigured magnification, on the display; perform an image stabilizationby configuring a parameter value as a first value; determine whether anobject is detected within a specified area of the preview image for apredetermined time; and change the parameter value to a second value,based on a determination that the object is detected within thespecified area of the preview image for the predetermined time andperform the image stabilization by configuring the parameter value asthe second value, wherein the second value is different from the firstvalue.